When AI moderates online content: effects of human collaboration and interactive transparency on user trust

Abstract Given the scale of user-generated content online, use artificial intelligence (AI) to flag problematic posts is inevitable, but users do not trust such automated moderation content. We explore if (a) involving human moderators in curation process and (b) affording “interactive transparency,” wherein participate curation, can promote appropriate reliance on AI. test this through a 3 (Source: AI, Human, Both) × (Transparency: No Transparency, Transparency-Only, Interactive Transparency) 2 (Classification Decision: Flagged, Not Flagged) between-subjects online experiment (N = 676) classification hate speech suicidal ideation. discovered that AI for just as much humans, it depends heuristic triggered when they are told source moderation. also found allowing provide feedback algorithm enhances by increasing user agency.